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Klaboratioii and Dissuasion 

laaaasa 

k, The general problem is to devise a procedure for the evaluation of 
students in Agency training course® . This procedure is to have the following 
ciiaracieri sties : 

1- J& JhB«M , Jat ^AsilMs in the senae that it can be readily 
adapted, to meet the particular requirements of various courses, various 
class sites, various consuasr needs, etc. 

3& la CMJLii] Uff - It should not stake unreasonable or 

impossible demands upon instructors, and it should not pr em ise or pretend to 
give mcr© information than it can reliably provide . Forms and procedures 
should be staple* 

3*" It should be suwmlffyfvfl In providing information stated in 
clear, unambiguous terms. 

EEgt.Ml tto..g.tudent against unfairness both in the 
making of evaluations and in the dissemination of evaluation reports to 
others. 

* ,L\ ^^SBAA^MJatagXSM Port., of a career program, designed 
to contribute to a emulative record of an individual's Agency service. 

B* The immediate and specific goal is to devise an evaluation procedure 
for trial use in the Basic Intelligence Course which begins April 6. 

j&agaas&aa 

In devising, the system every effort was made to incorporate the ideas 
of instructors, training officials , training liaison officers, and n*** 
supervisors as gained from a series of interviews. Considerable' attention 
vas given to the problems pf b a l a nc ing the needs of consumers a gain st what 
instructors felt could be realistically evaluated* Tab D la a summary of 
the results of the Interviews. The next several paragraphs summarise the 
major problems considered and the principals adopted* 

A. Ifi aLJ&ari&Jte yy&ltt&ta id? a primary purpose of any training 
evaluation is to show what and how much a student has learned in the 
course. A .-eeondary but. still important purpose is to obtain both in- 
cidental and systematic observations of behaviors or characteristics which 
can be of value in career pl ann i n g* Which specific subject matters or skills 
shotild be taught is a matter for appropriate training officials to determine. 
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la reaching decisions on these questions, the significance for career 
planning and the possibility of observing reliably the trait under consideration 
are the criteria that will be fadloved. A continuing research program will 
be needed to insure that the proper knowledges, skills, and behaviors are being 
measured and recorded. 

B. ] \MLwU®te fit sa&M&m £&2hli iBSJUafl* Objective measures 
should be employed wherever and whenever possible. Ilciraally, objective eauinln*- 
ticca can readily be devised for testing the degree to which substantive know- 
ledge hat bean acquired. Essay examinations or written report© have their 
purposes, but the core of any evaluation of "academic H learning should be the 
objective test. In addition to individual standings based upon objective 
teats, the instructor should be permitted to express his own evaluations of 
the student *s achievement, baaed upon whatever information or impressions are 
available to him. Performance tests of skills acquired are generally difficult 
and tine-ccnsusdng, and should be used only where there is ample justification 
for the effort that will be required. 

Both systematic and incidental observations of behavior or personality 
characteristics should be incorporated in an evaluation system, each clearly 
labelled for what it Is. Systematic observations say be expressed as ratings 
obtained either frcu. instructors or from fallow students* The principle to 
follow is to obtain as many independent ratings as possible for each trait 
rated. 

for characteristics of particular importance to the Agency (e.g,, 
secarity-sdndedness } , extreme deviations can be brought out by simple 
rt Xes-He® questions, recognising that the questions will elicit significant 
inforsation only in rare eases. 

C* fisiL-am-. the re.ittl.ta of traini n£._evftluatlon be mde xcoet Reanineful? 

Tide can be achieved through the use of several techniques; 

1. iritogJAa la£<aa&Ufi&, Clear and unambiguous language 

is used. Information is clearly identified for what it is; objective test, 
instructors* evaluation of achievement, systematic ratings, or incidental 
observations. 

2. can be 
accomplished through the accumulation of norms for the tests and the 
evaluations given, so that a person’s record can be compared not only with 
those in his own class but to those in several classes, say the last four 
or five. As a means „ of further improving interpretations , results can be 
made consistent from class to class and from course to course. To do this, 
it is necessary to take into account differences in learning ability (as 
measured by the pre-training test battery) and to follow the principle that 
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insofar as the several basic courses overlap in subject sat ter, tbo same 
examinations or examination questions will be used. Interaction from these 
sources cm be used to "calibrate* standards among courses and classes . 

3« iBtoftUfltt .IffiT BBflMifaa sssaiam* A mechanism 

should be set up to eyet^atlcaULy combine the various evaluations for the 
earns etudeat in order to make pertinent career re© emendation©. 7h© ‘/E 
Staff should be responsible for this. 

4. Education of uLLconeorned with the training Program and Up 
• yiluftilaas . lot only should appropriate manuals and other materials be 
prepared for instructors and consuaerE, but there should be a continuous 
interchange of Information among thorn and the A/E Staff. 

2 * ggysra bto diikMto mX m&. QfAP&..$y$Xw%im 

report ? The major consideration here is the morale of the students and 
instructors . The latter needs to be sure hie evaluations will not be misused. 
Its former must have confidence in the fairness of the operation of the system. 
She "need to know* principle should be followed here, fine© corn© decisions 
made as a result of training evaluations my be as serious for the individual 
as those following a full psychological assessment, certain kinds of informa- 
tion should probably be presented only on f ace-to-f t contact with the 

consuaer. Any special consolidation of the reports prooably should fell into 
this category. 
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